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Abstract 

Many solutions for scientific problems rely on finding the first (largest) eigenvalue and eigenvector 
of a particular matrix. We explore the distribution of the first eigenvector of a symmetric random 
sparse matrix. To analyze the properties of the first eigenvalue/vector, we employ a methodology 
based on the cavity method, a well-established technique in the statistical physics. 

A symmetric random sparse matrix in this paper can be regarded as an adjacency matrix for 
a network. We show that if a network is constructed by nodes that have two different types of 
degrees then the distribution of its eigenvector has fat tails such as the stable distribution {a < 2) 
under a certain condition; whereas if a network is constructed with nodes that have only one type 
of degree, the distribution of its first eigenvector becomes the Gaussian approximately. The cavity 
method is used to clarify these results. 

PACS numbers: 64.60.De, 64.60.aq, 75.50.Lk, 02.10.Yn 
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I. INTRODUCTION 



Many problems in science can be reduced to the eigenvalue/ vector problem. The first 
eigenvalue/ vector have sometimes particularly important meanings in these problems. For 
example, the first eigenvector of the transition probability matrix in physics represents the 
largest transfer direction. In quantum physics, the assessment of the ground state is generally 
formulated as a first eigenvalue / vector problem^. To analyze the spin-glass system, we often 
use the spin-glass susceptibility as an indicator of the critical phenomena. The spin-glass 
susceptibility is derived from the covariance matrix of its spins, so that the first eigenvalue 
of the correlation matrix plays an important role, especially at the critical point^. 

We show the density function of the first eigenvalues/vectors that are evaluated from the 
adjacency matrices of the networks whose nodes have two different types with respect to 
their degrees in this paper. The adjacency matrix of this network is also reduced to a subset 
of the random sparse matrices and it seems that the property of the density function of the 
eigenvalues/ vectors on such matrices has not been clarified very well so far, especially on 
the first eigenvector distribution. 

We show the dependence of the density function on the ratio of two different degrees in 
this paper. If a network is constructed with two different types of nodes with respect to the 
degree then the distribution of its first eigenvector has fat tails such as the stable distribution 
(a < 2, ~ 0) under a certain condition; whereas if a network is constructed with only 
one type of degree, the distribution of its first eigenvector is the Gaussian distribution, 
approximately. 

We calculate the first eigenvalue/vector that is derived from taking the large system limit, 
using our developed scheme^ based on the cavity method and the scheme is applicable to 
a wide variety of networks. In the population dynamics method which we use to assess 
the density function of the cavity field of the network, we need to employ the sequential 
update strategy for a stable convergence, which will be explained later. We evaluate two 
dimensional density function of the cavity fields in this paper, whereas we mainly discussed 
the case that the independence can be assumed for two variables of the cavity fields in 
Ref. i.e. q(A, H) ~ q(A)q(H). 

We also explore a Poissonian network and a Laplacian matrix for comparison. We show 
that the Poissonian network and the network whose nodes have two different types of degrees 
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with a certain ratio have many similar properties. This similarity is clarified by the results 
of the cavity method. This means that many network properties are defined by the ratio of 
nodes that have the largest degree. We show the shape of the density functions, whereas we 
used the inverse participation ratio (IPR) to evaluate the skewness of the density function 
of the eigenvectors in Ref-j^J. We found a richer structure in the shape of the density 
function and we will describe those in this paper. The Poisonian netwrok is one of the most 
well-known Erdos-Renyi model which have been widely studied in network science^. The 
Poissonian network is also related with the graph bisection problem^. 

Using the diagonal matrix and the adjacency matrix which can be regarded as a random 
symmetric matrix, we can compose a Laplacian matrix. Random impedance networks can 
be represented by a Laplacian matrix and we can evaluate the density of resonances of the 
networks as the spectral density of the eigenvalues^. The well-known Google PageRank™ 
ranks World Wide Web pages on the basis of the first eigenvector of the Laplcian matrix 
whose entries represent the number of links of a huge network constructed with Web pages^. 
In networks science, the first eigenvector of the adjacency matrix is called the eigenvector 
centrality. 

Many properties have been clarified for the spectral density of the eigenvalues that are 
evaluated from the ensembles of large random matrices. We can find this clarified knowledge 
in random matrix theory and its related topicsii^. In random matrix theory, we also find 
a knowledge on the first eigenvalue distribution of dense matrices which is called as the 
Tracy- Widom distribution. However, relatively little is known about the distribution of 
the eigenvalues/vector for the random sparse matrices^ - — . The problem which can be 
described by a random matrix with a constraint is related to a wide region of science, e.g., 
combinatorial problems in computer science^, statistical properties of disordered conductors 
and of chaotic quantum systems^, since Wigner designed the random matrix theory to deal 
with the statistics of eigenvalues/ vectors of complex many-body quantum systems^. 

This paper is organized as follows. The next section introduces the model that will be 
explored. In section [TTT1 we describe a scheme for examining the eigenvalue/vector problem 
in a large system limit on based on the cavity method. In section IIVt we discuss some 
numerical methods used in this paper. The results are described in section |Vj Concluding 
remarks are presented in the final section. 



3 



II. MODEL DEFINITION 



In this section, we describe the method of constructing the network which is discussed in 
this paper. For this purpose, we make use of an adjacency matrix which uniquely defines 
the network structure. We construct the network whose nodes have two different types of 
degrees and it will be referred as 2-DTD network or 2-DTD model hereafter. This network 
can be regarded as one of the simplest cases of a network that generally has various types of 
nodes with respect to the degree. We also explore the networks whose degree distribution 
is the Poissonian distribution and that might be one typical case among networks that has 
various types of nodes with respect to the degree. This network is often mentioned as a 
model for the World Wide Web network and other scientific structures. We also find it in 
the bisection problem. 

A. Network contraction algorithm and adjacency matrix 

Consider a N x N real symmetric sparse matrix J = (J^) that is characterized by a 
distribution p(k), where k{= 0,1,2,...) denotes the number of non-zero entries in a col- 
umn/row of the matrix and represents the degree of the corresponding node. We set the 
diagonal elements of the matrices to zero, because we assume that there are no self-loops 
in the network. We define di that represents the degree of a node indexed i(= 1,2, ... , N) 
as follows: We draw a number k from the stochastic variable obeying the distribution p(k) 
and set d\ = k, and repeat the same procedure for all i. 

Now, we randomly decide the non-zero entries in a N x N adjacency matrix which 
represents the links of the network as the following algorithm^: 

(S) Prepare a set of indices U in that each index i attends di times. 

(A) Repeat the following until no suitable pair can be found. Choose a pair of elements 
(I, j) from U, randomly. If i ^ j and the pair (/, j) has not been chosen before, then 
make a link between them and remove the two elements % and j from U. Otherwise, 
we return them back to U. 

(B) If U is empty, finish the algorithm. Otherwise, return to (S) and start over again. 
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We set 1 to the elements of the adjacency matrix as corresponding with the link of the above 
network. This construction agrees with the usual definition of adjacency matrix. 

Here, we modify the above adjacency matrix as follows. We replace the values of the 
non-zero entries symmetrically i.e. = Jjj , and stochastically obeying the following 
probability: 

pj(J«|A) = ^^S(J t] - 1) + l -^8{J ij + 1), (1) 

where 5(x) denotes the Dirac delta function and < A < 1. The A controls the number of 
the negative entries which represent the links between two different groups in the bisection 
problem. We interpret the negative entries as frustrations that are often discussed in the 
spin glass model. 

In this paper, we discuss a property of an ensemble average of the modified adjacency 
matrices that generate from the same algorithm. For this purpose, we made the thousands 
of networks, running the above algorithm. 



B. 2-DTD network and Poissonian network 



Within the set of networks that have two different types of nodes with respect to the 
degree, we mainly focus on the networks whose nodes are the 4 or 8 degrees with ratio 
0.9:0.1: 



p(k) 



0.9 if k = 4, 

0.1 if k = 8, (2) 
otherwise. 



For comparison, we also show results on several other follows: the ratio is different 

from the above case, the value of the larger degree is different, and the network that all 
nodes are the same with respect to the degree. 

As regards a Poissonian network, if the support of the number of degrees is not bound 
by a maximum value, i.e. the number of non-zero entries in each row/column is infinite, 
the first eigenvalue generally diverges as N — > oo. To avoid this phenomenon, we assume 
that p(k) = for k larger than a certain value which is denoted by fc max . To normalize the 
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FIG. 1: Modified Poisson density p(k) and the ordinal Poisson density p poi (k). Crosses represent 
the modified Poisson density defined by Eq. ([3]) and circles represent the ordinal Poisson density. 

probability distribution, we modify the degree distribution for the Poissonian network as 

p(k) = P poi (k), $> P °W = X > ( 3 ) 

Prior Prior 

where p pm (k) = \ k exp(— A) / k\ is the original Poisson distribution and p nor is a normalization 
factor. In this paper, we explore the case shown in Figfj] in which is fc max = 8 and A = 4. 
The results of the Poissonian Network have many similarities with the results of 2-DTD 
model of Eq. (j2j) as will be shown later. 
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III. CAVITY APPROACH FOR FIRST EIGENVALUE PROBLEM 

The cavity method, a well-known method in physics, has be applied to many 
problems^^^*^. In this paper, we use the two-dimensional density function of the 
cavity fields. Using this method with the sequential update strategy, we obtain stable re- 
sults for a wider variety of networks including 2-DTD network and the Poissonian network. 
To obtain the stable results in the case that the density function of the eigenvector has a 
fat tail, we need to modify our previous method in Ref. |4j. In order to verify our results, 
we compare the results obtained by the cavity method with those evaluated by the power 
method. 
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A. First eigenvalue/ vector and message passing algorithm 



The first eigenvalue/ vector problem can be formulated as an optimization problem: 

mm{— w Jw} subject to \w\ 2 = N, (4) 

where niin{- • • } denotes the minimization with respect to w. From the above optimization, 
we derive the optimal values of w which equal to the eigenvector v of the matrix J. The 
first eigenvalue A is evaluated as A = (v) T Jv/N. 

When N — > oo, if the distribution of the Vi is the Cauchy distribution, then the variance 
is infinity. In this case, the following relationship holds: 



AT3/2 

Therefore, we need to modify the formulation of our problem (J3J) as 

min {— w r Jw} subject to \w\ 2 = N^, (5) 

Fortunately, the methodology we will explain is applicable in this case and Eqs. (1151) and 
f TT6]) are hold, although we may need a small modification for the convergence test. We 
will only explain the case of £ = 1. It is, however, easy to accommodate the description 
hereunder to other values of £. 

The optimization (J4]) can be performed by the method of Lagrange multipliers. The 
Lagrange function is 

C(w,X) = -w T Jw + X(\w\ 2 - N) 

= X ^ w i - 2 XI J *3 Wi w i ~ AiV ' ( 6 ) 

i=l i>j 

where A is a Lagrange multiplier. 

Focusing on the site indexed i and its surroundings, Eq §6§ is decomposed into 

Ci(wi\Ai, = Ai w] - 2H, Wi (7) 

where the coefficients of the second and first order terms, A, and Hi, which are called as the 
cavity field, are determined in a certain self-consistent manner, i.e., by the cavity method. 

To find the self-consistent values of Ai and ifj, we introduce auxiliary variables Aj-n and 
Hj^i, which respectively represent the second and first order coefficients of j G di, where 
the notation di is the set of nodes connecting directly with node i, see Fig. [2] 
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FIG. 2: Network that can be assumed locally a tree. 

If we regard our graph as locally a tree, then we can describe the local Lagrange function 
which is considered only the descendant of node i, 



Ci,di\l(Wi, {W j&di \i}) = A Vj\ - 2 Wi ^ J y w i + $Z ( A 3-** w ) ~ 2 H J-+* w j) ■ ( 8 ) 

jedi\i jedi\l 

To minimize the above function, we partially differentiate with respect to Wj. Then we 
obtain the relation, 

Jij Hj^ti 



Wj 



A 



(9) 



Substituting the above relation into the function (JS}, and if we compare with the function 
Ci^,i = A^i wf — IH^i Wi, then we find the following relationships: 



J' 2 



= X - 

jedi\i 



A- •' 



H irM = 



jedi\l 



A 



(10) 
(11) 



Under a given initial condition, we evaluate the above equations and calculate the fol- 
lowing values: 



A . = X-Y^Jl/Ai 

j£di 

Hi = ^ JijHj^i/A 



(12) 
(13) 



If we use the right value of A, i.e., the first eigenvalue of the matrix J then A{ and Hi become 
identical except for a numerical error even if the operation of Eqs. f fTDl - ffTBl are performed 



8 



again. The above procedure offers the exact result when the graph is free from cycles. 
However, when the graph contains cycles, the above algorithm is available to obtain the 
approximate results. The cycles lengths in the connectivity graph, constructed by random 
sparse matrices, typically grow as O(lniV) when N — > oo^, and thus, we can ignore the 
effects of the cycles. 



B. Cavity fields and population dynamical method 

We apply a macroscopic approximation to the cavity fields and describe those as a two- 
dimensional distribution, i.e., 

i=l / i=l j£di 

where n, is the number of nodes directly connecting to node i. 

When we choose an edge randomly and observe one terminal of the edge, the probability 
that the degree of the node is k is described as 

r(k) = . (14) 

Using this probability, we can describe the following self-consistent equation of q(A,H), 
which is consistent with eqs. ( flOl) and (II ID . 



q(A,H) 

J \{d.\ J dll l <,(.\ l .U 



k=l " j=l 



k-l j2\ ( k-l „ „ 



where (• • • ) g represents the operation that takes the average with respect to Jj and Jj obeys 
pj(J'j)- After q(A,H) is determined from this equation, the distribution of the auxiliary 
variables in the original system, i.e., 

N 

Q(A, H) ~ N~ l S(A - A t )5{H - H), 

8=1 
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is evaluated as 

Q(A,H) 

^max /» 

= E^ fc ) / \{dA 3 dH ] q{A v H j 



k=0 

The population dynamical method was used to evaluate Eqs. (fT5|) and (|T6l) . The densities 
if) at the right and left of Eq. ffTol) became identical only when we substitute the 
appropriate eigenvalue A and density q(A, H) in the right side of the equation. In other 
cases, the left density function is different from with right one. 

To find the appropriate value for A which must equal to the first eigenvalue A, we evaluate 
the following statistics for several trial values of A: 

1|„.|2\ 



T = J dA dH Q(A, H) (H/A) 2 (~ N^\v 



On the basis of pairs of A and T from the above results, we estimate the value of A when T 
equals to 1, This method is not easy to use when the density has a fat tail such as in the 
stable distribution (1 < a < 2), because the density decays as x~^ 1+a \ i.e., T — > oo. In that 
case, we need to employ another statistic such as the average of the absolute value of v iy i.e., 



U = N~ 1 J2\v i \ = J dAdHQ(A,H)\(H/A)\. 



In the population dynamical method, the distribution q(A, H) is decomposed into 
many pairs of A and H, i.e. {(A^ , iff), (A® , ),..., (A$ , ) } . Using this set 
in the right side of Eq. (fT5]) , we get the set of A and H for the next step t + 1, 
{(4 <+1 \ #i (<+1) ), (4 m) > #2 <+1) )> (A { n +1 \H { n +1) )}. To continue this procedure, there exit 
many update strategies. Here, we used the sequential update strategy: 

do k = 1,N 

(At i \Ht^= f {(Ar i \ H r\... 

end do 

where the function / represents the operation in the right side of Eq. (fT5l) . To stably obtain 
right results, we need to employ this sequential update strategy or other update strategy 

10 



which possesses similar characteristics with the sequential update strategy. For example, if 
the parallel update strategy, i.e., 

do Jfc = 1,N 

(At 1 \Ht 1) )=f{(Af\Hi%...,(A%\HU)} 
end do 

is used, then the simulation may not converge. 

IV. CALCULATION METHODOLOGY FOR EIGENVALUE/ VECTOR 
A. Power method 

We use the power method to calculate the first eigenvalue and eigenvector of a given adja- 
cency matrix. This method is well known to evaluate the first eigenvalue/vector numerically 
in practice. Assume that A is the n x n matrix having n distinct eigenvalues Ai, A2, A re . 
The eigenvalues are ordered in decreasing magnitude, i.e., |Ai| > | A2 1 > ••• > |A n |. We 
calculate the following sequential equations from an appropriately chosen initial vector x . 

y k = Ax k , 
1 

Xk+i = — y k , 

Ck 

where c k is an appropriate number to avoid the divergence of \xk\. If we substitute the value 
of \y k \ into Ck, then Ck and x k converge to the first eigenvalue Ai and the first eigenvector 
vi, respectively, i.e., 

lim x k = V\, 

k—>oo 

lim Ck = Ai. 

k— >oo 

In our case, the adjacency matrix J has eigenvalues A' l5 A' 2 , A^ which are ordered as 
A'i > A' 2 > ■ • ■ > \' n . Then, J might have a negative eigenvalue whose absolute value 
is larger than the largest eigenvalue, i.e. \[ < \X' k \. For this reason, we reconstruct the 
following matrix to evaluate the eigenvalue/vector of J. 

A = J + ijI, 

where J is the identity matrix and 77 is a certain positive number that satisfies 77 > 
minO, — A' x — A' fe /2. Additionally, the eigenvalues of A become X[ + 77, A 2 + rf, A n + r/. 
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B. Scaling of A 



To find the value A for N = oo using the power method, we assume that the eigenvalue 
A and the size of the matrix N are related as follows: 

A(N) = exp(A N~P + B) (17) 

where for each A, A is a constant and B and (3 are positive constants. We can evaluate 
A(oo) = exp(.B). We found the above equation heuristically from several possible candidates 
and there is not theoretical validity for the equation so far. To evaluate the values A, B 
and (3, we take the logarithm of the above equation: 

log A(N) = AN' 13 + B 

and using the linear regression, we find the optimal values of A, B and /3. This relationship 
holds very well in some cases, however, the relation does not hold for all the cases. 

C. Normalization of eigenvalues 

In this section, we describe the normalization method of the first eigenvector v and the 
values of Vi (= H^/AA in the cavity method. It is necessary to normalize these for better 
comparison. There are many normalization methods and one of the most common methods 
is to set the value of the variance equals 1, i.e., 

i 

where N is the size of the vector or the number of population in the population dynamical 
method. We use the above normalization in Fig. |6](b), Fig. [7]of A = 0.8, 1.0, Fig. [91 Fig. [TU1 
and other similar figures below. 

The above normalization is not available when the tail of the density decreases as 

d(x) ~ x~ {1+a \ (Ka< 2), (19) 

because the density function does not have a finite variance. In this case, we need to use 
another normalization method such as 

^En = 1 - (2°) 

i 

We use this normalization in Figs. |6] (a) and (c), Fig. [7] of A = 0.0, 0.3, 0.6, and other 
similar figures below. 
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FIG. 3: First eigenvalue A versus A for 2-DTD model. Networks are constructed by 4 and 8 
degrees of links in the ratio of 0.9:0.1. 

V. RESULT 

In this section, we show the results for the models whose network nodes have two different 
types of degrees and whose degrees distribution is the Poissonian distribution. In addition, 
we show the results for the Laplacian matrices in the Appendix. 

A. 2-DTD network 



We show the results for networks that are constructed by the 4 or 8 degrees of connections 
with a ratio of 0.9:0.1. Figure [3] shows the results of the first eigenvalues evaluated by the 
cavity and power methods. For each A, the values of A are increasing with the system size 
N. To evaluate the A, we take the average of 2000 configurations, i.e., we calculate 2000 
first eigenvalues from 2000 different adjacency matrices. 

To estimate the first eigenvalue A for N = oo on the basis of the results of the power 
method, we assume that the eigenvalue A and the size of the matrix N satisfy the scaling 
relation of Eq. f|T7|) . The results fit very well as shown in Fig. HJ Figure [5] shows the values 
j3 evaluated by the above method. We estimate the critical value A c = 0.611, using the 
scaling method in Ref. ^. Corresponding with this critical value, the values of (3 are around 
0.5 in the region of A = 0.0 — 0.6 and around 0.9 in the region of A = 0.7 — 1.0. 
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JV-/J n-0 
FIG. 4: Results of the linear regression to find A(oo). The lines represent log A(N) = AN' 13 + B. 
In (a), A = -0.870, B = 1.465, = 0.539. In (b), A = -2.556, B = 1.503, (3 = 0.999. 
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FIG. 5: Values of /3. 

The results of the cavity method in Fig. |3] resemble those obtained by the power method, 
although the results of A using the cavity method are greater than those obtained by the 
power method with the scaling correction. The reason for this discrepancy is not clear but 
it might be that the results from the scaling correction are underestimated or the results 
of the cavity method are overestimated for some reason. As is well known for this type of 
problem, the finite size correction may be necessary for the finite size scaling. The line of A 
calculated by the cavity method becomes almost flat at a little less than around A = 0.7. 
This value is not corresponding with the critical value A c = 0.611 which we described in 
Ref. fl. 

Now, we confirm that the density functions evaluated by the first eigenvector of the 
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FIG. 6: Scaled density of the first eigenvector v for 2-DTD model. Networks are constructed by 4 
or 8 degrees of links with the ratio of 0.9:0.1. (a) is for A = 0.0 and is normalized as Y2i \ v i \ = N. 
An inset is its magnification around Vi = region, (b) is for A = 0.8 and normalized as ^ vf = N . 
(c) is the log-log plot of the cumulative distribution of (a) for the region of V{ > 0. (d) shows the 
convergence to the result of the cavity method assessed by S in the limit of N — > oo. 



adjacency matrix and the cavity method are consistent unless the finite size effect. We use 
a notation d(vi) to represent both the density function of the first eigenvectors v and the 
values Vi (= Hi/Aj) in the cavity method. Figures E] (a) and (b) show the density functions 
d(vi) of the model whose network nodes have two different types of degrees, that is the degree 
4 and 8 with a ratio of 0.9:0.1. Figure [6]^a) is A = 0.0 and (b) is A = 0.8. We compare 
the density functions for four different system sizes iV = 2 9 , 2 10 , 2 11 , 2 12 and the results of 
the cavity method in each figure. There are some differences between smaller and larger A 
whose boundary is around the critical point A c . For smaller A, for example A = 0.0, there 
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FIG. 7: Densities of the first eigenvector v for 2-DTD model. Networks are constructed by the 
degree 4 and 8 of links with a ratio of 0.9:0.1. The sizes of the matrices are N = 2 12 . The densities 
are evaluated from two thousand samples. 

are discrepancies around v , = and at the tail of the density function (see (c) and the inset 
of (a)). However, for larger A, the shapes of the density functions are similar for all N and 
similar to the result of the cavity method, see Fig[6](b) A = 0.8 for example. 

In Fig. a), A = 0.0, the tail of the densities based on the power method is shorter than 
that based on the cavity method. This is reasonable because the eigenvector of the finite size 
matrix with the finite entries must have a cut-off. The discrepancy around the vi = region 
is also caused because the size of the matrix is finite (see the inset of Fig. 0(a).) Figure E](c) 
shows the log-log plot of the cumulative distribution of Fig. [6] (a) for the region of Vi > 0. 
The slope of a straight line in the figure is —1.350 and this represents a = 1.350. 

To confirm the convergence of the density functions, we define the following value: 



where d\ and af represent an appropriately partitioned density of v j. In this study, the 
partition of the interval of Vi was taken as 0.2 to calculate S. Figure E^d) shows the values of 
S for each N. We find that the density d[ converge monotonically to af 8 " with increasing 
the network size. 

Figure [7] shows the density functions of the first eigenvectors for the network whose 
nodes have two different types with respect to the degrees. Using N = 2 12 , we compare 
the density functions of five different A, i.e., A = 0.0, 0.3, 0.6, 0.8, 1.0. We find that the 
density function has a fat tail in the region A < A c , although not in the region A < A c . 




(21) 
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FIG. 8: Contribution to density from two different degrees. Networks are constructed by degree 4 
and 8 of links with a ratio of 0.9:0.1. 

The results obtained from the cavity method are similar to these results, unless there exist 
some discrepancies, which we already mentioned. 

In Fig. [HI we show that the contribution to the density from the two different degrees for 
A =0.0, and 1.0. We find that the larger values of are constructed mainly of the nodes 
whose degree is the larger and the smaller values of Vi are constructed mainly of the nodes 
whose degree is the smaller, and vice versa. 

For comparison with the above results, in Fig. [91 we show results of another network 
where all the nodes are degree 4. The shapes of the densities are different from those of 
2-DTD model (e.g. Fig. [7J) The tail of the density function d(vi) is similar to the Gaussian 
distribution, whereas the power law for the 2-DTD model for small A. In the case that the 
degree of all the network nodes is only one type and degree 8, the results on the density 
function d{vj) is similar to those of the case in which all the nodes are degree 4, see Fig. [T0l 
From these results, we conclude that the heavy tail of the density function, which we saw 
in Fig. [7J is produced when the network has two different types of nodes with respect to the 
degree. 

Figure [Til shows the results of the model whose network nodes have two different types of 
degrees. The networks are connected by the nodes of degree 4 and 8 and the ratio is 0.1:0.9. 
Compared to the case in which the ratio is 0.9:0.1, see Fig. [7J the tail of the density function 
in Fig. [11] is similar to the Gaussian distribution which we observe when the network nodes 
are only one type of degree. 

Another feature is that there are two peaks for the case of A = 1.0, because the network 
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bO 




FIG. 9: Densities of the first eigenvector v. Networks are 4-regular graph, only. The sizes of 
matrices are N = 2 12 . x-axes is vf in the inset. 




FIG. 10: Densities of the first eigenvector v. Networks are 8-regular graph. The sizes of the 
matrices N = 2 12 . x-axis is vf in the inset. 

has two different type of degrees. The peak at the smaller v\ mainly comes out from the 
nodes with degree 4 and the peak at the larger V{ mainly originates from the nodes with 
degree 8, and vice versa, see Fig. [11] (b). 

In Fig. [I~27 a). we shows the result of the density functions d(vi) for the model such that 
the network has two different types of degrees for its nodes and the degrees are 4 and 12 
with a ratio of 0.9:0.1. In Fig. [T2T b). the degrees are 4 and 6. These figures are similar to 
the case of the degrees 4 and 8 with the ratio of 0.9:0.1, see Fig. [7J In Fig. [13], we shows 
the cumulative distribution of Vi for the network whose larger degree of nodes is 6, 8 and 12 
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FIG. 11: Densities of the first eigenvector v for the model whose network nodes are constructed by 
the 4 or 8 degrees of links with a ratio of 0.1:0.9. The sizes of the matrices are N = 2 12 . (a) shows 
results of four different A. (b) shows the contribution to the density from two different degrees. 
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FIG. 12: Densities of the first eigenvector v for a model, (a) is the case that network nodes are 
degrees 4 and 12 with a ratio of 0.9:0.1. (b) is degrees 4 and 6. The sizes of matrices are N = 2 12 . 

when A = 0.0. We find those are similar to each other. 
Here, we conclude the followings for 2-DTD network: 

1. The cavity method works sufficiently well for the 2-DTD model. 

2. The critical points evaluated by the scaling method and estimated by the cavity 
method are not in agreement, although those are close. The finite size scaling correc- 
tion might be necessary. 



3. Concerning A < A c , the density function d(vi) decays with the power law if the ratio 
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FIG. 13: Cumulative distribution of Vi for the cavity method. Network nodes constructed by 
degrees 4 and 6, 4 and 8, 4 and 12 are compared. A = 0.0. 

of the nodes whose degree is larger is sufficiently small, although the density function 
d(vi) decays exponentially when the network has sufficiently many nodes whose degree 
is larger. In addition, the magnitude of the largest degree does not affect the slope in 
the tail of the density function significantly. 

4. Concerning A > A c , the density function d(vi) decays exponentially in any case. 

5. The larger values of Vi originate from the nodes whose degree is larger, and the smaller 
values of Vi originate from the nodes whose degree is smaller, and vice versa. 

B. Poissonian network model 

Figure [H] shows the results of the first eigenvalues of the Poissonian network evaluated 
both by the cavity and power methods to the adjacency matrices. To eliminate the monopoly 
effect from very large degree vertices, we restrict the largest degree of this network as 8 
(= fcmax)' For this reason, our definition of the Poissonian model is as Eq. (J3J), as mentioned. 
To obtain these results in Fig. H~4T a). we take the average of 2000 configurations. The 
eigenvalues A increase with the system size N which is the same as for 2-DTD model. In 
addition, the results from the cavity method are slightly larger than those from the power 
method with the scaling method, especially at the lower region of A. In this case, the 
difference is larger than the case of 2-DTD network. This result might originate from the 
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FIG. 14: First eigenvalue A versus A of networks those degree distribution of nodes is the modified 
Poisson distribution, under the condition that the maximum degree is 8. 

increasing complexity of the network structure. 

Assuming Eq. (ITT)) , we find the values of A for N = oo as in the previous section. The 
data fit as well as those of 2-DTD model. Figure IT51 shows the values of (5 for the Poissonian 
network model. These results are similar to those of 2-DTD model. In Fig. HU the values of 
are around 0.6 in the region that the line of A evaluated by cavity method becomes flat. 
In other hand, in the region that the value of A increase with the value of A, the values of 
(3 are around 1.0. These results are similar to those of 2-DTD network model. From above 
all, the Poissonian network model might have the critical point between the areas in which 
the line of A is flat and has a slope. 

Figures ITBT a) and (b) show the density function d(vi) of the first eigenvectors v based 
on the power method and the values (= Hi/ 'AA based on the cavity method on the 
Poissonian network model. In Fig. (a), A = 0.0 and in (b), A = 0.8. In each figure, we 
compare the density functions for different system sizes N and the results obtained by the 
cavity method. Figure ITBT c) is the log-log plot of the cumulative distribution of d(vi) where 
Vi is in the positive region. Figure Efd) shows the results of Eq. (J21J). We could confirm 
that the results obtained by the adjacency matrix converge to those obtained by the cavity 
method when N — > oo, calculating S of Eq. (refconvergence-assess). 

From the above facts, we make the following conclusions: 

1. The cavity method also works sufficiently well for the Poissonian network model. 
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FIG. 15: Values of f3. 

2. Concerning the Poissonian network model, many important features such as the heavy 
tail for the density function and the shape of the first eigenvalue are similar to the 
results of the network that has only two different types of nodes with respect to the 
degree. 

VI. CONCLUDING REMARKS 

We showed the properties of the first eigenvalue/ vector for several kinds of adjacency 
matrices. The cavity method is available for all those matrices. It is often necessary to know 
the properties of an infinite large system in many studies such as the combinatorial problems, 
the random matrix problems, the network science and so on. Therefore it is important to 
establish a searching method such as the cavity method to explore the properties of the 
infinite large system. In this paper, we mainly focused on 2-DTD model and the Poissonian 
model. We also explored the Laplacian matrix and confirmed that the cavity method can 
be useful for that, see appendix. 

The value of the critical point of A c for degree 4 network is still unknown. It might not 
be easy to find the critical value using the methods in this paper. Therefore, it is required 
to find another method capable of rigorously determining the critical point A c . The finite 
scaling method might be useful to determine the critical point A c , whereas it is known to 
be hard sometimes^. 
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(b)A = 0.8 



(c)A = 0.0 
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FIG. 16: Density of the first eigenvector v for the Poissonian network, (a) is for A = 0.0 and it 
is normalized as Y2i \ v i\ = N. The inset is its magnification around the region that is close to the 
origin with respect to Uj-axis. (b) is for A = 0.8 and normalized as £^ v f = N. The inset is its 
magnification around the region that is close to the origin with respect to Uj-axis. (c) is the log-log 
plot of the cumulative distribution of (a) for the region where v i is positive, (d) shows convergence 
to the result of the cavity method evaluated by Eq. (|21[) when N — > oo. 



We showed in 2-DTD model that the density function of the eigenvectors has fat tails, 
i.e., it decays as the power law, when the ratio of the larger degree nodes is small; whereas 
the density function decays exponentially, when the majority or none of nodes are the 
larger degree. It seems that the power low decay of the density function originate from the 
construction of network, not from the variety of the degrees of nodes, if we consider the 
results of 2-DTD model and the Poissonian network model. 

There must be certain rule between the degree distribution and observables. For example, 
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there must be a rule on the ratio of degrees so that the tail of the density becomes the power 
law for small A in 2-DTD model. So far, we confirmed that using the cavity method, we 
observe a power law decay at the tail of the density when the network nodes have two 
different types of the degrees which are 4 and 8 with the ratio 0.5:0.5., whereas we cannot 
observe a power law decay using the analysis of the adjacency matrices whose sizes are 
N = 2 12 . Deciding boundary of A c and finding the relationship between the exponent of 
the density's decay and the ratio of degrees will be a future study. The relationship must 
also depend on the number of the larger degree if the number of the smaller degree fixed to 
4. This problem is related to the mathematical problem such that which type of transition 
matrix generates the stable distribution. 

The reason of the similarity of the graphs of /3 in Eq. 017p . i.e. Fig. [51 and [TBI seems to 
originate from the similarity of the properties of those two networks, because the graphs of 
/3 whose network nodes is only one type is not similar to those two graphs. Here, we should 
remind that there are many factors deciding the scaling law between the eigenvalue A and 
the system size N. 

We only focused on the statistical values of observables, i.e. all the results in this paper 
are the configurational averages of observables. It is important to study on each network 
that has a certain configuration. It is also important to study on the relation between the 
centrality and the distance among nodes whose degree is the largest in the network. 

We showed the density function of the cavity field A for the 2-DTD network in Fig. [TT1 
The degrees are 4 and 8 with a ratio of 0.9:0.1 under the condition that A ~ A. We found 
that the cavity field becomes united when A = 0.0, whereas separated when A = 0.8. 



24 



A = 0.0 



A = Oi 



5 

M 
O 




N ' CM 

~e 1 
o t 




A A 
FIG. 17: Density function of the cavity field A for 2-DTD network. Degrees is 4 and 8 with a ratio 

of 0.9:0.1, and A ~ A. 
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Appendix: Laplacian matrix 

On the basis of the adjacency matrix J = (J{j), the Laplacian matrix = {J if 1 ) can 
be made as follows: 

Jij ^ = ~Jij + $ij Jiji (A.l) 
3 

where all non-zero elements of J = (Jij) equal to 1, i.e., A — 1, in order to correspond with 
the definition of the usual Laplacian matrix. 

In order to evaluate the cavity fields for the Laplacian matrix, we adjust eq. ffTUl) and 
(fTTjl as follows: 

= A - t } " £ ^ ( A -2) 
= £ (A.3) 



where jf = - jj° = 

From the above equations, the distribution of the cavity fields, which correspond to eq. 
(EES]), can be described as 

g(A#) 



femax 1 

HdAjdHjqiA^Hj 

k=l J 7 = 1 



/72\ / ™ ^ /T ET 



where 
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N 


2 8 2 9 2 io 2 11 2 12 


Cavity 


A 


11.07 11.22 11.32 11.40 11.46 


11.53 



TABLE I: First eigenvalue A for the Laplacian matrix. The networks are constructed by nodes of 
degrees 4 and 8 with the ratio of 0.9:0.1. 

(a)A = 1.0 (b)Z\ = 1.0 
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FIG. 18: Density of the first eigenvector v for the Laplacain matrix derived from 2-DTD network, 
(a) is the semi-log plot, (b) is the log-log plot. 

And the equation corresponding with eq. (TIE]) is 
Q(A,H) 

^max p 

= Jj>W lYldAjdHjqiAjtHj) 



k=0 



5[A-X + J ii (k) + J2 

j=l 




6 h+y: 



i=i 



3j H 3 
A 3 



(A.6) 



J 



To calculate the equations ( 1A.4I) and ( 1A.6I) . we apply the population dynamical method. 

Table d shows the eigenvalues of the Laplacian matrix that the J = (J^-) is correspond 
with 2-DTD model whose degrees are 4 and 8 with a ratio of 0.9:0.1. We show the values 
for several system sizes and a result of the cavity method. It seems that the results show 
the convergence from small system size to the large and to the result of the cavity method. 
Figure [TBI shows the density functions of the first eigenvectors v and the values Vi (= Hi/Aj) 
in the cavity method. Here we can also confirm the convergence. 

From these results, we conclude that the cavity method works sufficiently well for the 
Laplacian matrix model. We also confirmed that the cavity method works sufficiently well 
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for the Laplacian matrix model which derive from the Poissonian network model, although 
we does not present these results in this paper. 
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